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ABSTRACT 


The United States Navy has a number of entities that work together to ensure that aircraft 
in the Navy are supplied with the parts and materials required to maintain mission 
readiness. An analysis of the operating and support system costs characterizes cost 
variance across Organizational-, Intermediate-, and Depot-level maintenance. In this 
report, we examine both labor and material cost for both repairable and consumable 
items, and categorize those costs by type of maintenance action. This analysis is intended 
to help in the development of a cost model that could aid in both budget planning and 
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I. INTRODUCTION 


A. MOTIVATION 


As professional aviation maintenance officers we wanted to pursue a topic that 
would benefit our entire community. Supporting aviation maintenance involves a balance 
of funding, manpower, and logistics. Parts and materials directly affect all three. 
Understanding how parts and materials influence our supply systems, troops, and drive 
cost, is the key to identifying weaknesses and the first step to process improvements, 
which, in turn, can reduce labor hours, lead times, and save money. By analyzing the data 
of a component with a high failure rate, and in turn, a high utilization, we hope a large 
amount of statistically significant data is available and can be used to answer the 


following questions. 


B. RESEARCH QUESTIONS 


By analyzing the current data collecting systems utilized by the Department of 
Defense (DoD), can naval aviation accurately predict proper inventories, safety stocks, 


and costs associated with organizational-, intermediate--level maintenance? 


Are the current data systems capturing the necessary data to make cost effective 


maintenance decisions at the Organizational and Intermediate levels? 
If not, what data fields should be added? 


What can be done to improve data collection? 


C. EXAMINING ORGANIZATIONAL-, INTERMEDIATE-, AND DEPOT- 
LEVEL MAINTENANCE COSTS 


1. Organizational-Level Maintenance 


Organizational-level (O-level) maintenance is performed by the maintenance 
personnel assigned to the operational unit or squadron. A squadron is a mix of officer and 
enlisted personnel, each assigned to a specific assignment or billet. A service member is 


required to have the appropriate level of training and/or the Navy-enlisted classification 
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(NEC)/designator/military occupational specialty (MOS). The NECs and _ training 
standards are required to ensure mission readiness and are governed by Naval Personnel 
Command (NAVPERS). NAVPERS determines the required levels of training, 
qualifications, and the number of personnel for assignment. This is calculated utilizing 
the documented number of work hours performed and the mission of the squadron or unit 
determines the manning levels and training requirements. The mission of O-level 
maintenance at a squadron is to maintain all assigned aircraft and associated aeronautical 
equipment in a full mission-capable status. Other duties associated with this process are: 
improving the local maintenance process, standing watches, and performing other 
required duties. All of these tasks feed the manning requirements for size and 


determining costs (COMNAVAIRFORINST, 2012). 


O-level maintenance can be grouped into three main categories: scheduled, 
unscheduled, and technical directive compliance. Scheduled maintenance is _ the 
primary form of maintenance performed at the O-level. Scheduled maintenance is 
designed to prolong and improve the life and performance of the system being serviced. 
Engineers with intimate knowledge of these systems determine the design and schedule 
of this type of maintenance. Some tasks are established at the birth of the system, while 
others are implemented as they are identified. Unscheduled maintenance occurs when 
systems unexpectedly fail and require repair and or replacement of good components. 
Technical directives (TDs) are implemented when trends occur and/or safe-for-flight 
concerns are raised. Most TDs are inspection based, but some require the removal and 
replacement of suspected faulty components. TDs are a preemptive approach to 


preventing catastrophic failure (COMNAVAIRFORINST, 2012). 


2. Intermediate-Level Maintenance 


Intermediate-level (I-level) maintenance is the next level of support. I-level 
maintenance personnel are assigned to a ship-based aircraft intermediate maintenance 
department (AIMD) or a shore-based Fleet Readiness Center (FRC). I-level maintenance 
is designed to provide a higher level of maintenance support, with improved capabilities 


to repair and test components. AIMDs and FRCs are capable of providing support to 
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multiple type/model/series (TMS) of aircraft. Pooling these resources allows the Navy to 
save money and improve the readiness of O-level maintenances. I-level commands are 
responsible for receiving parts, assessing the condition of the components, and 
determining the necessary action. Depending on priority and availability, parts are 
repaired and returned to the squadron for installation and use on the aircraft or for 
induction into the supply system. Parts that are beyond capable maintenance (BCM) are 
shipped to the appropriate depot-level maintenance activity or to the manufacturer. 
Among the Sailors and Marines that work in I-level facilities, civilian artisans are 
contracted to provide expert support and technical expertise, not only to repair 
components but also to train personnel. These artisans improve the capabilities of the I- 
level command and contribute to the professional development of Service members. Just 
as the O-level duties of the Service members vary, the work performed determines the 
manning of the AIMD or FRC and contributes to the cost of supporting a system. 
Artisans in AIMDs and FRCs also represent a cost of support (COMNAVAIRFORINST, 
2012). 


O- and I-level activity Service members share O- and I-level maintenance duties. 
This provides rotational assignments for Service members to complete sea/shore 
rotations, as well as to gain valuable O- and I-level maintenance experience 


(COMNAVAIRFORINST, 2012). 


3. Depot-Level Maintenance 


Depot-level maintenance includes naval aviation industrial establishments and 
commercial facilities. Depot repair consists of aircraft overhauls, rebuilding and repairing 
of parts, assemblies, subassemblies, and any other system that falls outside of the 
capabilities of the O- and I-level maintenance departments. Depot-level maintenance 
represents another level of costs associated with the operations and support of systems. 
These costs usually fall under aviation depot-level repairable (COMNAVAIRFORINST, 
2012). 
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I. BACKGROUND AND LITERATURE REVIEW 


A. BACKGROUND 
1. F/A-18 Hornet and Super Hornet 


Developed in the 1970s as a multi-role, all-weather, supersonic, twin-engine, 
carrier-based aircraft, the F/A-18 (Fighter/Attack) Hornet is a product of the combined 
efforts from McDonnell Douglas and Northrop Grumman. Its multi-role capability made 
it a versatile weapons system and set the stage for the F/A-18 Super Hornet. Flying its 
first flight in 1995, the F/A-18 Super Hornet was designed to replace the F-14 Tomcat. 
The F/A-18 family consisted of A, B, C, D, E, F, and G series, all of which were 
variations of the same aircraft, with the major differences being single or double-seated 
cockpits and variations in fuel capacity. Each new series of aircraft incorporated 
upgraded radar systems, avionics, and weapon-carrying capability. These variations 
helped tailor each series to a specific set of mission capabilities. The F/A-18 family of 
aircraft eventually replaced the F-14 Tomcat, A-6 Intruder, S-3 Viking, and EA-6B 
Prowler. With a single platform performing multiple roles, the F/A-18 provided an 
opportunity to drastically improve logistics support. For example, imagine seven TMS of 
aircraft on an aircraft carrier with each aircraft consisting of two types of tiers. To support 
these aircraft, the aircraft carrier must maintain an adequate number of tiers to ensure the 
full mission capability of its fleet of aircraft. Now, imagine if there were only three TMS 
of aircraft. The required number and variety of parts and materials required to sustain 


carrier-based flight operations is drastically reduced (United States Navy, 2009). 


2. Generator Converter Unit 


The F/A-18 Super Hornet’s generator converter unit (GCU) has experienced 
increased demand; changing system utilization is a common theme for many system 
components operated by the fighting forces in the DoD. Estimating the ever-changing 
utilization rates associated with a component and determining the strain and wear 
imposed is a challenge the DoD faces. This information is critical when determining the 
mean time between failures (MTBF) and, in turn, the reliability of the weapon system. 
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The GCU is similar to the alternator in a vehicle. It takes mechanical energy produced by 
jet engines of the F/A-18 and converts that into electrical energy for the appropriate 
systems of the aircraft to operate. Without a properly operating GCU, the F/A-18 cannot 
complete its mission. Currently, the GCU is the number one AVDLR and readiness 
degrader for the F/A-18 community. As subsystems of larger weapon systems upgraded 
changed and integrated, the effects of these changes are felt on other components that 
operate together to make the entire system function. The GCU is a great example of this, 
higher electrical loads and higher demands on the aircraft’s electrical systems is a result 
of components being removed and replaced by new ones to support the avionics that the 
aircraft utilizes, failures of the GCU can be attributed to the change in its utilization. 
Figure | illustrates a time stamp when the new radar system, Active Electronically 
Scanned Array (AESA) was installed and its demand placed on the GCU in 2005 
compared to the current utilization. The utilization change is illustrated by the volts and 
currents that the systems handles, the white strip represents the old radar system the gray 


strip represents the new demands after the new AESA was installed. 
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Figure 1. Generator Converter Unit’s Current Utilization 
(From Commander, 2010) 


Strains applied to the current system have caused the MTBF of the GCU to 
decrease. The new demand placed on the GCU is much higher than the original demand. 
Failure to correctly estimate the reliability and life of a system is extremely costly and in 


some cases dangerous to the operators of the system (NAVAIR, 2010). 


3. Level of Repair Analysis 


Level of repair analysis (LORA) is an analytical method to be used in determining 
the appropriate level of maintenance. LORA follows a series of steps that takes inputs, 
such as reliability of the system, maintainability, physical dimensions, weight, and so 
forth. Those inputs are then used to determine the optimal provisions of repair and 
maintenance facilities in order to reduce life-cycle cost and increase operational 
readiness. LORA helps solve problems as simple as how to avoid paying hundreds of 
dollars on transportation charges for a single $20 part or how to organize and staff an I- 
level facility. LORA is also responsible for determining the appropriate level to repair 
and or dispose high cost repairable items by creating cost-benefit analyses at each level, 


starting at the O-level and working its way up (OPNAVINST 3000.12A). 


4. Maintenance Data Systems 


The maintenance data systems (MDSs) were created to enhance naval aviation by 
tracking different maintenance actions and their effects on diverse elements of naval 
aviation. The NAMP (2012) describes MDS as a system that “furnishes data products that 
provide management tools for the efficient and economical management of maintenance 
organizations” (p 14.1.1). Maintenance organizations, such as I-level and O-level, are 
responsible for the proper incorporation of data that is uploaded into the Naval Aviation 
Enterprise (NAE) on databases such as Aviation Financial Analysis Support Tool 
(AFAST) and Decision Knowledge Programming for Logistics Analysis and Technical 
Evaluation (DECKPLATE) via MDS. The final data should be able to be utilized as a 
management information system data source tool for all levels of management in 


questions related to: 


e equipment reliability and maintainability, 
e material usage, and 
e maintenance material cost expenditure. 


MDS is the beginning of a series of building blocks that presents the big picture 
of maintenance, how much it really costs, and where the manager can find areas of 
interest in order to implement change or make an educated decision in order to better the 
system (COMNAVAIRFORINST, 2012). Currently, AFAST is widely utilized by the 
fleet as the preferred method to track and monitor spending throughout different 


operational commands. 


B. LITERATURE REVIEW 


Every year, the Department of the Navy (DoN) has to make decisions about the 
annual budget. These decisions are heavily based on readiness and modernization, two of 
the four pillars of military capabilities. According to the Congressional Research Service 
(CRS), readiness is “the ability of each unit to deliver the outputs for which it was 
designed,” while modernization is “technical sophistication of all the elements of the 


force” (Tyszkiewicz and & Daggett, 1998, p. 265). 


To put it in simple terms, the DoD budget takes into account the factors of 
sustaining current capabilities and supporting the incorporation of new capabilities. The 
link between those two pillars, our research, and the way DoD budgets in the present 
economic situation is operating and support (O&S). The goal of this project is to identify 
the cost of O&S throughout the maintenance cycle; and focusing on a component, such as 
the GCU, will help capture the data. We believe that by identifying more, if not all, the 
costs associated with O&S, better maintenance decisions can be made, and the DoD can 
improve the way it budgets in order to better sustain readiness throughout the fleet and 


also plan for future. 


1. Current Cost/Expenditure System Used by the Navy 


Unger (2009) depicted the relationship between multiple systems’ expenditure 


patterns, flying hours, and fleet sizes. Unger’s work recognized the complexity of the 
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system and acknowledged that there are different costs; some are affected by flying 
hours, some by fleet sizes, and others by a complicated mix of the two or sometimes one 
and not the other. Additionally, Unger (2009) explained that the mixed cases appeared to 
be a manifestation of fixed-plus-variable cost structure, which is not constantly 
compatible with the traditional Air Force CPFH program. Unger (2009) addressed the 
current categories by which costs are separated and presented to higher echelons for 
review during budgetary processes. Table 1 shows the expenditure categories elements as 
described by the Office of the Secretary of Defense (OSD) Cost Analysis Improvement 
Group (CAIG). 


Table l. CAIG Costs 
(From Unger, 2009, p. 2) 





CAIG Cost Element Descriptions 
CAIG Element Description 
1.0 Mission personnel Cost of pay and allowances of officer, enlisted, and civilian personnel 


required to operate, maintain, and support operational systems 


2.0 Unit-level consumption Includes the cost of fuel and energy resources; operations, maintenance, 
and support materials consumed at the unit level; stock fund 
reimbursements for depot-level reparables; operational munitions 
expended in training; transportation In support of deployed-unit training; 
temporary duty pay; and other unit-level consumption costs 


3.0 Intermediate maintenance Intermediate maintenance performed external to a unit, including the cost 
of labor and materials and other costs expended by designated activities’ 
units in support of a primary system and associated support equipment. 
Indudes calibration, repair, and replacement of parts, components, or 
assemblies and technical assistance 


4.0 Depot maintenance includes the cost of labor, material, and overhead incurred in performing 
major overhauls or maintenance on a defense system, its components, and 
assodated support equipment at centralized repair facilities, or on site by 
depot teams 


5.0 Contractor logistical support Includes the cost of kontractor labor, materials, and overhead incurred 
in pons all or part of the logistics support to a weapon system, 
subsystem, or associated support equipment. The maintenance Is 
performed by commercial organizations using contractor or government 
material, equipment, and facilities 


6.0 Sustaining support Includes the cost of replacement support equipment, modification kits, 
sustaining engineering, software maintenance support, and simulator 
operations provided for a defense system 


7.0 Indirect support Includes the cost of personnel support for specialty training, permanent 
changes of station, and medical care. Also includes the costs of relevant 
host installation services, such as base operating support and real property 
maintenance 


The Secretary of the Air Force, Financial Management (SAF/FM) directorate 
developed a category cost element different from CAIG groups. The intention is to 


99 66. 


account for “the variable with flying hour,” “variable with tails,” and “fixed” costs 
(Unger, 2009). The original concept was later changed after the report analysis yielded 
new, unexpected results between variations in different level or stages, especially at the 
depot level. Table 2 is the Air Force expenditure category scheme that resulted from the 


analysis. 


Table 2. Alternative Air Force Expenditure Categorization Scheme 
(From Unger, 2009, p. 26) 











Variable cost per flying hour Variable cost per TAI 


2.1 POL/energy consumption 1.2. Maintenance personnel 

2.2 Consumables/repair parts 
2.5 Other unit-level consumption 
5.2 Contractor logistics support 
6.1 Support equipment 

7.1 Personnel support 








Partially variable cost per flying hour Partially variable cost per TAI 


1.1 Operations personnel 1.3 Other mission personnel 














Fixed costs 


7.2 Installation support 





NOTE: We cannot determine 2.3 + 4.0 (depot maintenance), 2.4 (training munitions), 3.0 (intermediate 
maintenance), 5.3 (other contract support), 6.3 (other recurring investment), 6.4 (sustaining equipment 
support), 6.5 (software maintenance), and 6.6 (simulator operations). 











Unger (2009) provided our project with a platform from which efforts could be 
oriented by following some of the work conducted by the Air Force and comparing it to 
the current cost/expenditure system utilized by the Navy. Because our current research 
intends to identify factors that affect O&S, a methodology similar to that used by Unger 
may be usefully applied, and makes cost comparisons across Services easier. 


10 


2. Making Accurate Cost Decisions 


According to a Government Accountability Office (GAO) report dated July 20, 
2010, the DoD cannot effectively manage and reduce O&S costs for most of the weapon 
systems that the GAO reviewed. The GAO office analyzed and compared life-cycle O&S 
cost estimates and historical data on actual O&S costs. The GAO found that five of the 
seven aviation systems reviewed did not have the life-cycle O&S cost estimates 
developed at production milestones, and the data used to calculate costs was incomplete. 
Incomplete and insufficient data forced the DoD to make inaccurate calculations when 
determining O&S costs. Providing accurate data, and the ability to analyze the rate of 
O&S cost growth, identifying cost drivers, and developing plans for managing and 
controlling costs are essential for the successful calculation of O&S costs. Updating 
methods, identifying life-cycle O&S costs, and identifying cost drivers will aid in the 
accuracy of estimates. These measures need to be re-evaluated periodically throughout 
the life of the system (GAO, 2010). By using the GCU’s historical data, we hope to 
highlight the factors affecting the GCU, as well as use the lessons we learn from the 
GCU’s data to build a model that will aid in the accuracy of future calculations for other 


systems and their components. 


Our research and findings are not intended to design a new activity-based cost 
system. However, there are lessons and approaches activity-based costing uses that help 
provide a good product and information that leads to the formulation of a good, 
competitive strategy. In “Measure Costs Right: Make the Right Decisions,’ Cooper and 
Kaplan (1988b) explained that costs are categorized and separated so that they can be 
traced back to their origins and show the true cost of the individual component to the 
company. This is extremely important when calculating the O&S costs of a weapon 
system. Understanding and identifying the fully burdened costs associated with the 
weapon system is the only way to identify the support ability of the system and its value- 
adding capabilities to the organization. Cooper and Kaplan (1988b) covered the important 
aspect of the cause of distorted data. They explained that current cost systems typically 
overstate costs of high-volume items and understate costs of low-volume items, thus 
providing misleading information and leading to inaccurate decisions (Cooper & Kaplan, 
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1988b). A central goal of our thesis is to demonstrate an approach to gathering and 
categorizing costs to facilitate decision making. We will also raise questions about the 


accuracy, or at least the completeness of that data. 


Dy Identifying the Relevant Data 


As a result of the Secretary of Defense’s policy on usage of specifications and 
standards, MIL-PRF-49506, LMI, has been developed to replace MILSTD-1388—2B. It is 
not a revision of MIL-STD-1388-—2B. Rather, it represents a fundamental change in the 
way data requirements are levied on contracts. MIL-PRF-49506 does not contain any 
“how to” requirements. The new specification is designed to minimize oversight and 
government-unique requirements (p. 7—2).! While this manual has been canceled the 
DoD’s MIL-STD-1388-1A (The DoD’s Military Standard (MIL-STD; 1983), a military 
standard logistic support analysis, is a publication that covers many aspects of logistics 
support. Task Section 400, Determination of Logistics Support Resource Requirements, 
provides detailed guidance regarding the process of assessing the O&S costs that must be 
considered before a system can be adopted and when a new system’s production line is 
about to be closed. Upon examination of the Super Hornets, the DoD utilizes the GCU to 
determine its effective service life and the Navy’s measures and processes for changing 
and adapting a weapon system to best combat constantly changing global threats. The 
MIL-STD (1983) Section 403 provides guidance for weapon systems reaching the end of 


their life cycle. It identifies key areas to assess regarding the system/equipment, such as: 


e expected useful life, 

° support requirements, 

* problems associated with inadequate supply after termination of product 
line, and 

e ability to predict and solve support inadequacies. 


The overall purpose of this instruction is to ensure that all aspects of a weapon 


system are considered before it is implemented, extended, or changed, and the 





! This is copied from the Department of defense handbook acquisition Logistics MIL-PRF-49506. (p 
7-2). 
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appropriate data is collected during the life of the system so that the appropriate decisions 
can be made. We considered many of the same metrics outlined in Section 400 (MIL- 


STD, 1983), such as identifying: 


e logistics support resource requirements for each task, 

e new or critical logistics support resource requirements, 

® participants in the support process and their required resources, 
° effects of new strains on weapon systems, 

e estimations of the life of aging components, and 

e reductions in O&S costs. 


Utilizing the data provided, we hope to classify areas that can be identified as key 
causal factors, or metrics that can be better used to identify and explain O&S costs 
associated with the system. The MIL-STD (1983) provided us with a good starting point 


and guidance regarding the current system used. 


Accurate forecasting of the demand for spare parts is vitally important for 
maintenance but the sporadic nature of demand makes accurate forecasting difficult (Hua, 
Zhang, Yang, & Tan, 2007). Hua et al.’s (2007) study centers on how excess inventory of 
Spare parts increases costs and how important it is to manage these costs that come from 
holding inventory and from inadequate inventory controls. They described the case of a 
Chinese company that held spare inventory of approximately $12 million out of 
$21 million total inventory with a turnover of 0.58 times per year. While we do not 
attempt to develop a forecasting model for spare parts, the Hua et al. (2007) study shows 
how spare parts affect O&S estimations and demonstrates that effective sparing levels 
are necessary the for cost effective management of maintenance processes. To have 
effective sparing levels, the Navy must capture accurate and relevant maintenance data at 


the Organizational and Intermediate level. 
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4. Establishing Measures 


The United States Marine Corps is growing concerned about expenditures 
generated from the organizational and intermediate (O&I) levels; moreover, Romero and 
Elliott believe efforts to reduce budgetary impact on O&S must be taken before it is to 
late (Romero and Elliott, 2009). Romero and Elliott began their thesis, Developing a 
United States Marine Corps Organizational and Intermediate Level Maintenance 
Performance Cost Model, by noting a multitude of O&S cost drivers, such as inventory, 
OPTEMPO, and equipment age, procurement costs that are not within the scope of 
decision-makers. Furthermore, Romero and Elliott (2009) suggested that by developing a 
method to understand and analyze the relationship between cost variations and the 
continued increases in spending, DoD could support sustainment budgetary requirements 
in the annual funding process. In this manner, budgetary planners could have a more 
reliable way to forecast future budgets, especially during times of monetary uncertainty. 
Romero and Elliott (2009) presented an example about how overestimating inventory has 
created extra spending with the Marine Corps. With the end of operations in Iraq and a 
drawdown over the horizon at Afghanistan, a question must be asked: What is going to 
happen to the inventory built to sustain the wars? The DoD has created inventories to 
sustain operations, so the question is this: When is the right time to take the foot off the 
gas, particularly when war itself is so unpredictable and may not present an exact final 
day? Questions like these are extremely important to our project because the costs 
associated with the sustainment of operations can be vastly complex and variable Romero 
and Elliott (2009) covered the importance of identifying the very aspects that can be 


affected by the lowest level of maintenance. 


According to Dixon (2006) in The Maintenance Costs of Aging Aircraft: Insights 
From Commercial Aviation, a close study of how commercial aircrafts age could help 
military decision-makers understand how “aging effects” affect cost estimation over time. 
In the cost study, Dixon (2006) covered three separate linear regressions by computing 
age effects on aircraft age zero to six years old; the second, aircraft age six to 12; and 
lastly, aircraft age 12 and older. Dixon (2006) displayed the results of the RAND study as 


follows: group one shows a maintenance increase cost rate of 17.6% per year; group two 
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displays an annually increase rate of 3.5% per year; and group three yields a surprising 
0.7% increase per year. Dixon (2006) also explained that organizations must assume a 
rapid constant increase in cost with age; however, other studies show that such 
assumptions are incorrect. Furthermore, the reason the younger aircraft result is higher 
than the rest is due to a cost-shift from manufacturer-provided maintenance to owner- 
provided maintenance after the warranties have expired (Dixon, 2006). Dixon’s point is 
that leadership in the military must spot such changes while projecting future budgets not 


as a linearly increasing cost but as a midway point at which costs needs to be reevaluated. 


Utilizing flight hours to calculate the life of an airframe and its components is the 
most widely used and accepted method of measurement. A linear relationship is assumed 
to exist, along with the assumption that all parts on the aircraft have constant failure rates. 
These assumptions do not factor into the age of the weapon system or components, or 
into the change in mission or utilization of the weapon system and its components. In our 
analysis of the GCU’s data, we hoped to identify trends in the failure rates and make 
correlations to the age and/or utilization of systems the GCUs support. In A Method of 
Forecasting Repair and Replacement Needs for Naval Aircraft: Phase II, DeLozier and 
Wilkinson (1986) defined the variables that could be used in a method for forecasting 
repair and replacement needs for naval aircraft phase I]. These variables include the 


replacement rate, fraction recycled, failure rate and repair rate. 


Delozier and Wilkinson (1986) provided valuable insight to aid our interpretation 
of the current maintenance data. Models such as this need accurate data to predict 
replacement rates. Our analysis will examine the data used to determine failure rates, and 


fraction replaced that impact replacement rates and costs. 


Understanding how to identify which costs are fixed and which costs are variable 
is important. This process is complicated further by the mix of funds that the DoD uses to 
cover expenses. Cooper and Kaplan (1988) discus costing systems which can cloud the 
waters and make it difficult to see what the true expenses are or how making changes to a 
process or systems, which will affect the costs associated with the mix of funds that are 
intended to, support the program or system. Understanding the impact of changes and the 


importance of identifying costs, as well as understanding errors in the way data is 
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recorded and interpreted, makes it difficult to form a plan of attack. Data collection 
systems which are easy to use and understand, not only by management but also by the 
frontline user, greatly enhance the accuracy and volume of data collected. The DoD has 
many systems collecting data to form an array of measures. We use multiple sources of 
data to examine how costs which may seem “fixed” at a high level actually vary across 


categories at the Organizational level. 
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Hl. METHODOLOGY AND DATA SOURCES 


A. METHODOLOGY 


Our results are derived from using Microsoft Excel to manipulate data collected 
and stored in AFAST and DECKPLATE databases. Microsoft Excel and our data sources 
are tools available to today’s naval officers. Using tools and data that are available to 
aviation maintenance officers can benefit the community, identifying strengths and 
weaknesses in the data, as well as describe and use methods to make better use of the data 


collected. 


The data used to calculate the following results is derived from a merging of 
AFAST and DECKPLATE data, starting March 23, 2009, and ending September 30, 
2010. This data range was selected because it represented the current consecutive FYs 
that have been completed. By selecting the last two FYs, we hoped to identify any new 


trends or tease out information that had not been discovered yet. 


The merging of maintenance data from DECKPLATE, a system that NAVAIR 
maintains in Patuxent River, and AFAST Requisition and Cost data, a system which is 
maintain in San Diego at COMNAVAIRPAC. These separate inputs created the 
combined product that was utilized. The DECKPLATE Work Order Info (all) data field 
was matched with the requisition information in DECKPLATE then the AFAST cost data 
was added to match the requisition information. The merging of DECKPLATE and 
AFAST data was completed by Mr. Kevin Doyle, a data analyst at COMNAVAIRFOR 


based on our request. 


Organization of the data was accomplished by extensive use of Microsoft Excel 
pivot tables. Pivot tables automatically sort, count, total or give the averages, of the data 
field selected, for example by selecting the merged DECKPLATE and AFAST data one 
can easily and quickly be manipulate the data. Pivot tables make sorting and organizing, 
this large volume of information easier and more accurate, by removing a majority of the 
manual data manipulation, thus removing the chance for human error in the data entry. 


The Pivot table displays the results in a second table (called a “pivot table”) showing the 
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summarized data. Changes can be made to the summary’s structure by dragging and 
dropping fields graphically. The “rotation” or pivoting of the summary table gives the 


concept its name. 


Line items totaling 5579, each with 80 data fields of information, represented a 
snap-shot of the GCU’s maintenance history. Seventeen pivot tables were created and 
utilized to filter, organize and analyze this data. Manual grouping the job control numbers 
(JCN) was completed in order to build our correlation tables. The 5579 individual JCNs 
could be tied to 186 mother JCNs. 


Pivot tables provided the core descriptive statistics that are the central part of our 
analyses. In addition correlation tools were also used to demonstrate the sorts of post-hoc, 
or ‘what if? analysis that could be performed by naval aviation professionals if the sorts 
of tables we built in this thesis were made available to them. We utilized Excel to create a 
Phi Correlation to see how often items are order together (Cramer, 1946). Phi 
Correlations are appropriate for measuring the strength of association between binary (or 


dichotomous) variables. The Phi Correlation coefficient is defined as. 


(a-d) -(b-c) 


(a+5)-(€+d)-(a+c)-(b+¢) 





where a is the number of observations in which both variables are coded ‘1’, b is the 
number of observations in which the first variable is coded ‘1’ but the second is coded 
‘0’, c is the number of observations in which the first variable is coded 0 but the second is 


coded ‘1’, and d is the number of observations in which both variables are coded ‘0’. 


The data used in these correlations is converted from quantities ordered to item 
ordered or not, a binary repression of the data. The correlation is intended to show if there 
was an interaction between parts, for example if there was a part used to repair the GCU, 
were there any other parts used in conjunction with that part as well. For this reason we 
changed the data to binary where | (one) represents a part that is used to repair the GCU 
and 0 (zero) represents the absence of a part being utilized. Microsoft Excel’s CORREL 
tool provides an output table with values illustrating the strength of their correlation, +1 
representing items that are perfectly positively correlated -1 representing items that are 


18 


negatively correlated. Phi Correlation tools are not available in Microsoft Excel so we 
coded them manually using Excel. Phi correlation results were formatted to find the result 
in the same visual representation as the Microsoft Excel’s CORREL tool output table, 


making it easier to read and compare to our results. 


In this project, we take a close look at the costs of aviation, the costs of aviation 
maintenance, and the systems that capture that data. Utilizing the same data sources used 
by the Navy to track and store maintenance information, we track parts through the 
maintenance and supply system capturing O-, I- and depot-level maintenance actions, 
failure rates, and costs. Data sources used by the Navy already capture a large portion of 
the maintenance transaction; by using this data, we identify the strengths and weaknesses 
of the current data system, as well as paint a picture of costs associated with naval 
aviation maintenance for a single item. Exploring accessible online databases tools such 
as AFAST, DECKPLATE, and VAMOSC that track historical cost data throughout the 
fiscal year, we use these tools to identify costs and changes that contribute to significant 


costs variations for that item. 


The item we selected was the GCU. By examining the GCU, we focus our data 
collection and analysis. With the GCU’s current high utilization rate and its impact on the 
F/A-18 weapon system, data analysis on the GCU is important for the fleet. Also, 
because there is a great deal of data related to the GCU in our source datasets, we ensure 


that we can extract enough data to demonstrate the usefulness of our methodology. 


B. DATA SOURCES 


Aviation maintenance involves a lot of data collection in order ensure 
maintenance actions are properly performed and documented. This process is intended to 
provide vital information that is critical to the safety of the aircrew and personnel 
performing maintenance on the aircraft; ensuring accountability, the tracking of parts and 
materials are also functions of this data collecting. By combining the data collected from 
aircraft that are of the same TMS or that utilize the same parts and materials, the DoD can 
quickly identify trends, anticipate demands, and ensure proper stocking levels. Using a 


combination of data sources utilized by the DoD, we identify the cost of repairable 
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components on the Navy across O-, I-, and depot-level maintenance. Section 1 of this 


chapter is a description and reason for the use of the following data systems. 


1. The Navy Visibility and Management of Operating and Support Costs 


The DoD utilizes information from all Services to make budgetary decisions. The 
Services provide information from a database source called VAMOSC. VAMOSC is a 
management information system that collects and reports U.S. Navy and Marine Corps 
historical O&S costs. In 1975, the Deputy Secretary of Defense directed all Services to 
collect actual weapon systems O&S costs. In 1992, management of the Naval VAMOSC 
to provide executive oversight was assigned to the Naval Center for Cost Analysis 
(NCCA) and to the OSD CAIG. Today, VAMOSC provides data of direct and indirect 
O&sS costs of weapon systems; it also provides non-cost information, such as flying-hour 
metrics, age of aircraft, and so forth, VAMOSC also contains military personnel 
databases composed of personnel costs and has recently added databases covering Navy 
Department civilian personnel and Navy facilities physical characteristics and operating 


costs (VAMOSC, 2012). 


VAMOSC databases are intended as information files to be used in appropriations 
and cost analyses. These data are used to develop the O&S portion of Life-Cycle Cost 
(LCC) and estimates indirect costs for future weapon systems. They also contribute to the 
Navy’s efforts to reduce the total ownership cost (TOC) of legacy and future weapon 
systems. VAMOSC is being used to identify significant cost drivers that represent cost 


reduction opportunities (VAMOSC, 2012). 


The VAMOSC (2012) appropriation accounts applicable to the current project are 


as follows: 
e Aircraft Procurement, Navy (APN)—Procurement of new aircraft, 
modifications to existing aircraft, and spare parts; 
e Other Procurement, Navy (OPN)—Procurement of ship and aviation 


support equipment, communication and electronic equipment, ordnance 
support equipment, civil engineer support equipment, supply and 
personnel/command support equipment, and spare and repair parts; and 
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° Operation and Maintenance, Navy (O&MN)—Expenses necessary for 
support of the fleet, civilian employee pay, travel and transportation, 
training, consumable supplies, recruiting and advertising, base operations, 
and base communications and subsistence. 


2. Cost Analysis Improvement Group 


CAIG, now called the Cost Assessment and Program Evaluation (CAPE), was 
created as an independent standard cost estimation parameter utilized by the DoD during 
acquisitions and any cost tracking or estimation event. CAPE is also consistent with DoD 


regulations and is under administrative control by an appointed DoD official. 


Table 3 was extracted from the VAMOSC website, and it shows the CAPE cost 
elements utilized by cost estimators. The data is historical and is collected from several 


different reliable sources such as MilPers, NAVAIR, and so forth. 


Table 3. . ATMSR TMS Query CAIG Forma Fiscal Year 1997 to Present 
(From VAMOSC, 2012) 


F/A-18F 





Constant FY11 Dollars Count 






2.1 Operating Material 2.1.1 Energy (POL, Electricity) 297,914,264.00 
2.0 Unit Operations 2.1.2 Training Munitions and Expendable Stores 






10,150,936.00 


$ 

$ 
es cicssc0 
3.1 Organizational Maintenance and Support Eee a s  136,440,499.00° 
eT so sizcesc0 
Js aoaraasao 


3.2.4 Government Labor 


3.2.5 Contractor Maintenance 


8.8 Depot Maintenance 2.3.2 Contractor Depot Repair §  1,189,562.00 
41/Sytem Specific Training 4.1.1 System Specific Operator Training $ 2,424,307.00 


5.0 Continuing System Improvements 5.1 Hardware Modifications or Modernization Se ee] $ 154,551,948.00 
A1.2 FRS Aircraft Number |A1.2.1 FRS Aircraft Number - Navy 72 
A2.2 FRS Total Annual Flying Hours /A2.2.1 FRS Annual Flying Hours - Navy 19,185 
AS.2 Barrels of Fuel Consumed - FRS 'A5.2.1 Barrels of Fuel Consumed - FRS - Navy 569,318 
P1.0 Unit-Level Total Personnel Count P1.2 Maintenance Manpower Count 2,461 


P1.3 Other Personnel Count 


3.0 Maintenance 3.2 Intermediate Maintenance 





495 
P2.1 Intermediate Personnel Count - Maintenance 577 

P2.0 Total Intermediate Personnel Count 
P2.2 Intermediate Personnel Count - Other 20 


Sum: $ 1,143,538,416.00 
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The following are level elements as defined by CAPE (2007):2 


1.0 Unit3-level manpower includes the costs of all operators, maintenance, 
and other support manpower at operating units. Unit-level manpower costs 
are intended to capture direct costs (i.e., costs of unit-level individuals that 
can be clearly associated with the system performing its intended defense 
mission). It includes MilPers costs (e.g., basic pay, allowances, 
entitlements, etc.). 


1.2 Unit-level maintenance manpower is the cost of all military, civilian, 
and contractor manpower that performs unit—level maintenance on a 
primary system, associated support equipment, and unit-level training 
devices. 


1.3 Other unit-level manpower is the cost of all military, civilian, and 
contractor manpower that performs administrative, security, logistics, 
safety, engineering, and other mission support functions at the unit level. 


3.0 Maintenance includes the costs of labor (outside of the scope of the 
unit level) and materials at all levels of maintenance in support of the 
primary system, simulators, training devices, and associated support 
equipment.* 


3.1 Organizational maintenance and support includes the cost of materials 
and other costs used to maintain a primary system, training devices, 
simulators, and support equipment. 


3.1.1 Organization-level consumables include the costs of materials 
consumed in the maintenance and support of a primary system and their 
associated support and training equipment at the unit level. Illustrative 
types of maintenance consumables are coolants and deicing fluids. 


3.1.3 Organization-level Depot Level Repairable (DLR) includes the net 
cost the operating unit incurs for DLR spares (also referred to as 
exchangeable items) used to maintain equipment at the unit level. 


3.1.4 Contract maintenance services includes the separate costs of 
contract labor, materials, and assets used in providing maintenance 





2 The CAPE level elements were taken directly from the VAMOSC User Manual and are in 
accordance with DoDI 5000.02 and DoD 5000.4M. The elements display costs that are followed by the 
DoD while describing money estimates for various programs because it brings essential understanding to 
the true cost of a system as a whole 


3 Unit in the purpose of this MBA project can be defined as a squadron- or Organizational-level 
command. 


4 This cost is tracked by Numbers JCNs and order documents generated at the O-level. 
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services to a weapon system, subsystem, support equipment, training 
device, or simulator at the unit level. 


3.2 Intermediate maintenance includes the cost of labor and materials and 
other costs expended by I-level maintenance organization in support of a 
primary system, simulators, training devices, and associated support 
equipment. Where I-level maintenance activities cannot be separately 
identified from O-level maintenance, the costs are often combined as 
either organizational or intermediate maintenance. 


3.2.4 Government labor includes the costs (using DoD standard composite 
rates, or hourly equivalent) of military and government civilian manpower 
that performs intermediate maintenance on a primary system, simulators, 
training devices, or associated support equipment at I-level maintenance 
activities. 


3.3 Depot maintenance includes the fully burdened cost of labor, material, 
and overhead incurred in performing major overhauls or other depot-level 
maintenance on a system, its components, or other associated equipment at 
centralized repair depots, contractor repair facilities, or on site by depot 
teams. 


3.3.1 Government depot repair includes government labor, material, and 
support service costs for depot repair. 


3.3.2 Contractor depot repair includes the separate costs of burdened 
contract labor, material, and assets used in providing maintenance services 
to a primary system, subsystem, or associated support equipment. If 
possible, labor, material and other costs should be displayed separately. 


3.3.3 Other depot maintenance costs not otherwise included. For example, 
this could include second-destination transportation costs for weapons 
systems or subsystems requiring major overhaul or rework, special testing, 
environmental costs, transportation of field repair teams, and technical 
assistance that is unique to the system and not included elsewhere in the 
estimate. 


4.0 Sustaining support includes support services provided by centrally 
managed support activities external to the units that own the operating 
systems. 


4.1.2 System-specific non-operator training includes the costs of advanced 
system-specific training associated with maintenance and other support 
functions in units designated as primary training facilities. (WAMOSC, 
2012) 
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3. Decision Knowledge Programming for Logistics Analysis and 
Technical Evaluation 


DECKPLATE is a new reporting system based on the Cognos incorporated 
analysis, query, and reporting tools. It provides report and query capabilities content- 
equivalent with the current Naval Aviation Logistics Data Analysis (NALDA) systems 
and allows reporting and analysis capability not available with the current systems. The 
new web-based reporting system provides a sound basis for future implementation of 
emerging DoN architectural requirements. DECKPLATE is the next generation data 
warehouse for aircraft maintenance, flight, and usage data. The system provides a web- 
based interface to a single source of the information currently being stored in multiple 
NALDA systems. Through the use of Cognos analysis, query, and reporting tools, the 
user has the capabilities to effectively obtain readiness data in a near real-time 
environment, as well as history data for trend analysis and records reconstruction 


(DECKPLATE, 2012). 


Figure 2 displays data flow and how DECKPLATE serves as a centralized data 


warehouse of all current aviation systems under the NAE. 
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Figure 2. DECKPLATE Data Flow 
(From COMNAVAIRFORINST, 2012). 


4. Aviation Financial Analysis Tool 


AFAST was developed as a result of a study conducted at Commander, Naval Air 
Forces Pacific (COMNAVAIRPAC) in 1994 by 23 reserve officers who were chief 
executive officers (CEOs) or chief financial officers (CFOs) in their civilian capacity. 
They were tasked by Vice Admiral Spane to advise him on how better to run 
COMNAVAIRFOC Commander, Naval Air Force Pacific (COMNAVAIRPAC) like a 
business. One of the study group’s conclusions was that while COMNAVAIRPAC’s 
financial tracking and analysis were up to industry standards, there was no cost 
management applied to the flying hour program (FHP). Their study had identified two 


tools already in existence in the fleet that could be used as a source of data to build a cost 
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management system at COMNAVAIRPAC. Their recommendation was to develop 
AFAST using those systems as data sources. The two systems identified were the 
Aviation Store Keeper Information Tracking (ASKIT) system and Naval Aviation 
Logistics Command Management Information System (NALCOMIS) AIMD Cost 
Accounting (NACA) system. ASKIT was selected to provide flight hours and fuel costs 
accumulated monthly by squadron and reported via the budget operating target report 
(BOR). NACA input files, extracted from NALCOMIS, were selected as a source of 
squadron and AIMD costs via the requisition and maintenance action form (MAF) data. 
The reserve group was tasked to develop a prototype at Naval Air Station North Island. 
The prototype evaluation was completed in October 1995, and the decision was made to 
implement in all COMNAVAIRPAC activities that were supported by the NALCOMIS 
within the AIMD. The implementation was completed in 1996, and training was provided 
by the reserve group to the COMNAVAIRPAC staff. The original AFAST software was 
developed by the reserve group and supported by a contract with the Naval Computer and 
Telecommunications Station (NCTS) in San Diego, CA. This contract ended at the end of 
fiscal year (FY) 1996 and subsequent support and development has been provided via a 


commercial contractor (NAVAIR). 


The AFAST program was monitored by the COMNAVAIRPAC FHP Executive 
Steering Committee (ESC) to track the progress of cost reduction initiatives that were 
undertaken. The ESC decided in FY1999 to involve the type wings in monitoring the 
FHP costs in their respective type model aircraft. Training was provided to the Type 
Wings and additional tools were developed to support the wing involvement. The original 
tool (AFAST User) was enhanced, and two new tools were developed. The two new tools 
were the Type Wing FHP Cockpit Chart and the TWING Detail Analysis tool. All 
exported tools have been developed as MS Excel spreadsheets or MS Access databases to 
ensure Navy/Marine Corps Intranet (NMCI) compatibility and compliance. The master 
AFAST database is maintained at COMNAVAIRPAC on a dedicated file server. This 
database is updated and maintained by AFAST contractors and used to produce the other 
tools monthly. These tools are produced after the flight hours have been certified in the 


comptrollers Aviation Cost Evaluation System (ACES), which is the official financial 
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reporting system used to produce the Flying Hour Cost Report. AFAST draws the BOR 
data from ACES after certification. AFAST captures only direct maintenance costs as 
documented via Intermediate Maintenance Activity IMA) NALCOMIS. These costs are 
the results of squadron and IMA requisitions generated in NALCOMIS and MAF data 
used to identify BCM actions on repairable items. AFAST does not capture financial- 
only transactions. These transactions include contract costs, financial adjustments, 
carcass charges, and requisitions not submitted via NALCOMIS. The business rule 
established at inception was that AFAST must capture 85% of costs to be an effective 
cost management tool. Currently, AFAST captures approximately 90% of FHP costs 
(AFAST, 2009). 


C. DESCRIPTION OF DATA FIELDS USED 
1. Job Control Number 


JCN is a 9-to-11 alphanumeric characters number utilized to identify different 
jobs conducted on the aircraft. The JCN is the main master data record (MDR) or 
document utilized to track maintenance procedures and material discrepancies, and to 
order parts and materials. It contains information such as man hours, order document 
numbers, and all other fields described in the data fields. It also provides a link between 
maintenance actions performed at I-level in support of the maintenance discrepancy 
initiated under a particular JCN. There is only one JCN per repairable item; conversely, 
there can be several consumable items ordered tracked under one JCN. An original JCN 


would follow a set format that is separated into four sections. 


e First, a three-digit code that identifies the originating command. This code 


is known as the ORG code. 


e Second, a three-digit Julian date to identify when the JCN was created. 
e Third, a three-digit serial number to identify, in sequence, the actual job 
number. 
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° Fourth, the suffix, or SUF, to identify a sub-assembly or sub-sub- 
assemblies repair actions performed independently of the major 


component repair and used only for I-level maintenance actions. 


For example a repairable component, such as the GCU, will have a JCN (e.g., 
AD6259018) if there is another repairable part needed to fix the GCU at the I level, then 
a suffix, would be added at the end of the original JCN (e.g., AD62590181A). Therefore, 
by looking at the JCN, we can see whether there were other actions taken to repair the 
part; moreover, we can identify other repairable components utilized to fix the original 


sub-assembly (COMNAVAIRFORINST, 2012). 


Figure 3 is a visual example of how a JCN looks, starting with the original job 


and any other parts to support them. 


Main JCN AA8236349 
generated by the squadron 





Figure 3. Job Control Number Representation 


The JCN data was dispersed throughout DECKPLATE and AFAST. Each JCN 
was in its own individual row as expected nonetheless, it created a complication while 
trying to find and group main JCNs with its associated SUF. Therefore, we created a 
pivot table that displayed the JCNs as the “row label” and NIIN, EXTPRICE in the 
values columns. Once the original pivot table was set we had to organize the JCNs, first 


in ascending order and finally group the SUF with the original JCN. For grouping we 
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utilized the group row function from Excel at the end of the process we had several rows 
of JCNs and its correspondent SUF. The new JCN pivot table was easier to read and it 
showed the different charges against the original JCN which also represents charges 
against the GCU. Another benefit of the JCN pivot table is that by adding the NIIN field 
to the row label will display the NIINs ordered against the original JCN, in other words it 
displays the parts required to fix the GCU. 


Nevertheless, manually grouping the JCNs was a long and tedious task that is not 
practical to maintenance officers in the fleet. However, there is a great deal of 


information that can be gained by looking at this set. 


2. Type Equipment Code 


The type equipment code (TEC) is a four-digit character code used to identify the 
complete end item or category of equipment being worked on. This number is used to 
identify the type model series (TMS) involved (COMNAVAIRFORINST, 2012). Using 
the TEC code to filter the data, trends in specific systems common to a variety of aircraft 
can be found. For example, in our data, TEC code were used to organized groups of 
aircraft with identical configurations the GCUs found in the FA-18 are used in the 
following variants F/A-18E, F/A-18F and F/A-18G, the F/A-18G is the electronic counter 
measure variant of the F/A-18 designed to replace the EA-6B. Once the data is grouped 
by TEC codes it is easy to identify which group of aircraft if any is experiencing the 
highest number of failures per aircraft. In our data we found that the F/A-18E is 
experiencing roughly 13 failures per aircraft over the timeframe cover by our data, this is 


the highest number of failures per aircraft compared to the other TMSs involved. 


3. Commercial and Government Entity 


Commercial and Government Entity (CAGE) is a five-position code assigned to 
manufacturers and non-manufacturers, organizational entities and contractors of items 
procured by agencies of the federal government. These codes help identify who 


manufactured the part (COMNAVAIRFORINST, 2012). 
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4. Action Taken 


Action Taken (AT) Code A is a one-character alphabetic or numeric code that 
describes what action has been accomplished on the item identified by a Work Unit Code 
(WUC). These codes include the multiple categories of BCMs, as well as information 
regarding the repair (COMNAVAIRFORINST, 2012). The AT code provides the ability 
to sort GCUs that were repaired from the GCUs that were BCM. 


Using pivot tables and the AT codes as the sorting data field, then pair that 
information to maintenance activity performing maintenance on the parts via the “action 
origination short name” (a data field used in DECKPLATE), a consolidation the data 
sorted by groups under each maintenance activity, this provides a summary of man hours, 
parts ordered, and associated costs for each site. For example we could instantly see of 
the 1,388 “BCM1 — repair not authorized” four of them were issued by the AIMD 
onboard the USS RONALD REGAN. By organizing the data this way the total number 
of items process for each AT code as well as the associated man hours can also easily be 


identified. 


5. Beyond Capable Maintenance 


BCM, a term/code used by I-levels when repair is not authorized at that level or 
when an activity is not capable of accomplishing the repair because of a lack of 
equipment, facilities, technical skills, technical data, or parts (COMNAVAIRFORINST, 
2012). BCM is also used when shop backlog precludes repair within the time limits 
specified by existing directives. BCM codes are used to identify quantities and reasons 


for GCUs to be sent off for depot-level repair. 


6. A National Item Identification Number 


A National (or North Atlantic Treaty Organization [NATO]) item identification 
number (NIIN) is a nine-digit numeric code that uniquely identifies an item of supply in 
the NATO Codification System (COMNAVAIRFORINST, 2012). NIINs allow us to 
filter and identify each component and the number of components used to repair the 


GCU. NIIN are extremely important while using pivot tables because the information 
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associated with the individual NIN represent quantitative factors such cost in dollars, 
man hours and items ordered. This information provided us with means to identify cost 
drivers, frequently ordered items, and also man hours expend while repairing GCUs. 
Therefore, by using the NIIN, we could see which of the internal components was failing, 


how often, and how much it cost to repair. 


Ts Malfunction Description Code 


Malfunction description code (MAL) is a_ three-character numeric or 
alphanumeric code used to describe the malfunction occurring on or in an item identified 
by a WUC (COMNAVAIRFORINST, 2012). Filtering the data by MAL codes and 
counting the number of times a specific MAL code is used then organizing the MAL 
codes by number of re-occurrences it a fast and easy way to see trends in specific types of 
failures. For example 374 is the code representing an internal failure, this code appeared 
1043 time, far more times than any other code, this information can be used as the first 
step to identifying what the components are failing internally, these codes are utilized 
throughout the maintenance process and very as new discrepancies and found and 


discrepancies are documented against the part being repaired 


8. Measures of Maintenance Hours 
a. Elapsed Maintenance Time 


Elapsed maintenance time (EMT) measures the duration of an event from 
start to completion, regardless of the number of personnel performing the maintenance 


(COMNAVAIRFORINST, 2012). 


b. Man-Hours 


Man-hours are used to measure the time each individual spends to 


complete a single discrepancy (COMNAVAIRFORINST, 2012). 


9, Serial Numbers 


Removed/installed equipment serial numbers are located on the part and are 


entered into maintenance data systems for record keeping. We used these numbers to 


31 


keep track of how GCUs are the moved through the maintenance and supply systems 
(COMNAVAIRFORINST, 2012). Tracking these serial numbers could be useful to find 
individual component failures. For example if there is an internal component that fails 
continuously shows that the particular component has a high rate of failure and needs to 
be stock in inventory. Conversely, if the component is not identified as a high failure 
component by looking at different maintenance organizations we could conclude that 
there is another factor creating the failure. Serial numbers pivot table could shed light on 
internal failures that are affecting other internal parts or high utilization components due 


to ordinary failure rates. 
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IV. RESULTS 


Our analysis focuses on providing information associated with costs that are 
followed and used by the DoD to describe financial estimates for various programs. Our 
hope is to provide an essential understanding of the true cost associated with a system 
and its subsystems, as well as, increase the accuracy and detail of the data used by CAPE 
and other cost analysis groups during acquisition and budget estimation. The results 
obtained by our analysis were from AFAST and DECKPLATE data fields relate and 


influence current level elements as defined by CAPE. 


A. JOB CONTROL NUMBERS 


A JCN is the main MDR; thus, it creates the means to track all maintenance 
actions back to the original job, a SUF JCN is added in order to accommodate an I-level 
action, these SUF JCNs represent additional actions, parts and materials that are required 
to repair the system associated with the main JCN, such as ordering a repairable part to 
repair a GCU. Excel views the SUF JCN’s as an individual JCN which are not part of a 
mother JCN, manually grouping JCN’s by the authors became a necessary evil. Table 4 
displays an example of a pivot table which groups SUF JCNs into the original JCN. 
JCN’s are extremely useful in this regard, the ability to track the parts and materials to 
the original discrepancy helps to tell the story; however the tools in Excel do not 


automatically group JCN’s together. 
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Table 4. Pivot Table for Job Control Numbers 


Row Labels CountofNIIN SumofManhours Sum of EXTPRICE] |Row Labels CountofNIIN SumofManhours Sum of EXTPRICE 
JCN PA2302369 (series) 68) |JCN AG8003047 (series) 2 149.5 $96,360.00 
AIMD N .68; | AIMD EISENHOWER ll 148 $56,541.00 





Jan 4, 2010 

014793745 
012223502 .18 014951174 
014793633 014961068 
014793739 Feb 10, 2010 
014793773 





Sub totals 








Jan 010 
Feb 14, 2010 
014793633 
VFA-143 
Jan 3, 2010 
Jan 3, 2010 
014553692 














Oct 29, 2009 
014553692 





Interesting contrasts were discovered by comparing different commands. During 
the analyzing of the JCN tables, such as comparing Strike Fighter Squadrons VFA-143 
deployed on the aircraft carrier USS DWIGHT D. EISENHOWER and Strike Fighter 
Squadrons VFA-14 deployed on the aircraft carrier USS NIMITZ. The tables were 
showing marginal differences in cost which was expected since parts cost the same, 
however, there was large difference seen regarding total man hours, especially at the I- 
level or AIMD. While both had ordered almost the same amount of parts for a relatively 
equal cost they did not have the same amount of hours. Table 4 compares two different 
JCNs, The main JCN from the USS NIMITZ AIMD accounted for 3,795 total man hours, 
contrasted with 148 hours executed by the USS EISENHOWER AIMD. As we know 
man hours add cost to the GCU or any other components because of the manpower 
requirements. We decided to add ordering dates and received dates to the tables so we 
could see how long it took to repair the component. We found that only those parts that 
were not received the same date had man hours. In accordance with the NAMP, man 


hours measures the time each individual spends to complete a single discrepancy so we 
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were surprised to see zero hours on parts that were received the same day. The example 
on Table 4 shows a time frame of 45 days, at the same time, there are exactly 345 man 
hours for each part. We thought that the 345 hours represented the time AIMD took to 
repair that particular sub-component, for example the time it took to fix a circuit card. 
However, when looking at a part common to both JCNs, NIIN 01-479-3633, we noticed 
that this part was a packing which is a consumable part rather than a repairable item. We 
believe these hours represent an awaiting-time laps rather than hours spent by 
maintenance personnel doing repairs. We came to that conclusion because the other parts 
that were received the same day have zero hours. Furthermore, the evidence of several 
consumable items with the same times as each other clearly indicates that those hours 
were not spent in repairing those individual components. Inaccurate representation of 
man-hours affects the accuracy of manning, over documentation of man-hours will inflate 
manning, under documentation will reduce manning and drastically affect readiness. 
Getting these numbers correct is extremely important to personnel costs allocations and 


to the DoD financial and operational planning. 


B. TYPE EQUIPMENT CODE 


TECs were used to distinguish variants in weapon systems and the associated 
failure rates specific to that system. For example, the GCUs high failure rate has become 
a problem for the F/A-18, and therefore, identifying the cause of the decreased mean time 
between failures is important to correcting the problem. Using the TECs and JCNs, we 
can determine the number of maintenance actions being performed to correct GCU 
discrepancies. Table 5 illustrates how we can determine which variant is experiencing the 
greatest rate of failure by comparing that variant’s data to the number of aircraft 


associated with that TEC group. 
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Table 5. Type Equipment Code, Job Control Number, and Aircraft Count Used to 
Determine Percentage of Failures 


Number of , Discrepancies 
: : Variant i 
Discrapancies ; per aircraft 


F/A-18E 13.10 
F/A-18F 11.43 
| 66 | F/A-186 





The TECs can provide a starting point for determining the cause of increased 
failures. As seen in Table 5 the F/A-18E has the greatest percentage of failures, which 


makes it a good place to start examining the cause of GCU failures. 


C. ACTION TAKEN CODES 


AT codes provide an easy way to identify how discrepancies were corrected, or 
whether the required repair was beyond the capabilities of the repairing activity. The AT 
code provides information regarding the reason the receiving activity cannot repair the 
part. Similarly, BCM codes and cannibalization codes are particularly important to cost 
identification. The costs associated with BCMs are inorganic and typically high whereas 
cannibalizations represent a failure in the supply system, causing unnecessary additional 


maintenance hours to be performed. 


Table 6 provides a short definition of each AT code currently used, as well as, the 
number of times each was used in the data sample we analyzed. Table 6 also highlights 
the maintenance hours executed before a part was considered BCM, maintenance hours 
executed repairing GCUs, and maintenance hours executed on the cannibalization of 


GCUs caused by inadequate supply levels. 
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Table 6. Action Taken Codes Used to Illustrate Beyond Capability of 
Maintenance, Cannibalization, Repairs, and the Associated Maintenance 
Hours 





ATCodes | Count of Action Taken 
BCM 2 - Lack of Equipment, Tools, or Facilities 
BCM 4 - Lack of Parts 
BCM 5 - Fails Check and Test 
BCM 7 - Beyond Authorized Repair Depth 


rr BCM 8- Administrative 


e 106 Items of Repairable Material or Weapon/Support System Discrepancy Checked No 
Repair Required. 


3 i Repair or replacement of items, such as attaching units, seals, gaskets, packing, 
tubing, hose, and fittings, that are not integral parts of work unit coded items or 

Cc 1,001 Repair 

5 590 Work Stoppage, Post and Redeployment, and Inter-Intermediate Maintenance 
Activity (IMA) Support 


Failure of Items Undergoing Check and Test 

















Total OF BCM's Total Repaired at I-level Total Repaired at O-level 


1,604 1,379 1,719 
Documented Man-hours spent before Documented Man-hours spent on Documented Man-hours spent on 
BCM repairing GCU's Cannibalization 


11,238 43,471 4,590 





When analyzing AT codes, we can easily see how our ability to repair and/or 
maintain adequate inventory levels drastically affects time spent repairing weapon 
systems. Using AT code, comparisons between maintenance activities can be made. For 
example, VFA-143 and VFA-103, aboard the aircraft carrier USS DWIGHT D. 
EISENHOWER and VFA-14 and VEFA-41, aboard the aircraft carrier USS NIMITZ, 
were deployed during roughly the same time frame, and experienced very similar 
operational tempos. VFA-143, a squadron of F/A-18Es, cannibalized 46 GCUs 
accounting for 298 maintenance hours. VFA-103, a squadron of F/A-18Fs, cannibalized 
23 GCUs which accounted for 99 maintenance hours, totaling 69 cannibalized GCUs and 
397 maintenance hours. These data allow you to compare maintenance practices, 
operations, flight hours flown and other variables between the two commands. Similarly, 
VFA-14, a squadron of F/A-18Es, cannibalized 32 GCUs accounting for 205 
maintenance hours., VFA-41, a squadron of F/A-18Fs, cannibalized 22 GCUs which 
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accounted for 219 maintenance hours, totaling 54 cannibalized GCUs and 
424 maintenance hours. Not only can you compare squadrons assigned to a carrier or 
battle group, but comparisons across battle groups or theaters of operation can be made. 
Comparisons are not limited to cannibalizations, for example The AIMD on board the 
USS DWIGHT. D. EISENHOWER assigned a BCMI status to 112 GCUs and its 
associated components. Meanwhile the AIMD on board the USS NIMITZ assigned a 
BCM1 status to 32 GCUs and its associated components. These comparisons invoke 
further questions and form the basis for future research questions, such as; what are 
AIMDs or squadrons doing differently, how are their operations affecting the system, and 


are the failures being caused by environmental factors or human error? 


D. MALFUNCTION CODES 


Malfunction codes can be used to identify trends in the types of failures. They are 
limited to the list of codes available and allow groups of similar malfunctions to be 
pooled together. The more specific or descriptive the code is, the more useful it becomes. 
Using the GCU’s data, we can easily see that internal failures are responsible for the 
greatest number of failures. This may not be enough to fix the problem, but it helps to 
narrow the search. This empowers the user to analyze subcomponents of the whole 
assembly and pinpoint the individual component that is failing. Thus, malfunction codes 
can guide future research, and examination of supporting data needed to solve the 


problem. 


E. NATIONAL ITEM IDENTIFICATION NUMBER 


NIINs are extremely useful; while common names, nomenclatures, and even part 
numbers vary from organization to organization, the NIIN associated with that 
component does not. Organizing the data by NIINs allows us to see which components 
are being ordered to repair the weapon system. NIINs can be filtered in a number of 
ways. For example by using the GCU’s data, we filtered NIINs to show the number of 
repairable and consumable components ordered. We then organized these lists into two 


groups: total number ordered and total cost. 
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Table 7 displays the top ten consumable items. Table 8 displays the top ten 
repairable parts used to repair the GCU; items on each table are arranged by greatest to 


least number of units ordered and display their costs. 


Table 7. Top 10 Consumable Parts Organized by Number Ordered 


Nomen | NIN [ Number Ordered | Total Cost| 





Table 8. Top 10 Repairable Parts Organized by Number Ordered 











Number Ordered 





Nomen 
POWER SUPPLY /|014793818 
CIRCUIT CARD 015452661 
ELECTRONIC CO |014708683 
MATCHED SET 015684018 


015664393 75| $ 1,416,483.00 


014951173 68} $ 329,223.00 
014708685 64) $ 124,679.00 


14708681 54| $ 1,025,031.00 








308,084.00 
488,784.00 
405,540.00 
742,607.00 


























WIM 1H | 








CIRCUIT, CARD 










ELECTRONIC CO 
ELECTRONIC CO 
GENERATOR,ALT 
























From Tables 7 and 8, we can see how NIINs represent the frequency of items 
ordered during a selected period to sustain repairs on a GCU. This information is used to 
calculate future inventories and help maintenance professional see trends in items that are 
been consumed at a higher rate than normal. More importantly, tracking the number of 


NIIN’s being ordered and understanding the failure rates of the individual components 
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could point out the need to re-work or repair the faulty components that are causing the 
larger, more expensive weapon systems to fail. By organizing the NIINs into ordering 
activities, pivot tables can help explore this data more precisely thus help eliminate 
outliers in the reparable components ordered. For example, looking at Table 7, the 
number one consumable ordered is an O-ring. Deeper expansion of the Pivot table shows 
that VFA-32 ordered 42 of the 181 O-rings, more than double the amount ordered by any 
other unit. By utilizing this information some assumptions can be made; VFA-32 could 
be ordering more than the amount required to build up their inventory of consumable 
parts, or possibly 41 O-rings failed before they were able to install a good one. Using the 
same data sample, the second highest consumable part ordered can be examined, once 
again VFA-32 ordered 42 O-rings, over double the amount ordered by any other unit. 
Depending on the actual reasons for the quantities ordered, this information could be used 
to eliminate both sets of O-rings as a major cause of GCU failures across the fleet. 
Conversely, the top repairable components ordered from Table 8 were the power 
supplies. By further examining that NIIN, we see that FRC Oceana and FRC Lemoore 
ordered 77.52 percent of that NIIN. FRC Oceana and FRC Lemoore are the only two 
major shore based repair facilities for the F/A-18. This information further supports 
examination of the power supply because of the total amount ordered. 

Table 9 displays the top 10 consumables, Table 10 displays the top 10 repairable 
components, including GCUs these tables are organized by total dollar amount each item 


represents within the data period used. 
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Table 9. |Top 10 Consumable Parts Organized by Total Cost of Items Ordered 


Nomen | NIN [Number Ordered] Total Cost| 





Table 10. Top 10 Repairable Parts Organized by Total Cost of Items Ordered 












Number Ordered 
















$ 1,416,483.00 
$ 1,025,031.00 


$ 742,607.00 


015664393 75 
014708681 54 
015684018 88 
015452661 105}$ 488,784.00 
014708683 92|$ 405,540.00 


014951173 68} $ 329,223.00 
014793818 178} $ 308,084.00 
014793620 43}$ 235,642.00 


CIRCUIT, CARD 
GENERATOR,ALT 
MATCHED SET 
CIRCUIT CARD 
ELECTRONIC CO 
ELECTRONIC CO 
POWER SUPPLY 
ELECTRONIC CO 




















































Determining cost drivers and the components that have the greatest impact on the 
budget is easy by utilizing NIINs to sort the data. This was also the same method used to 
filter Tables 7 and 8. After examining the cost drivers shown on Table 10, additional data 
mining revealed that FRC Oceana and FRC Lemoore consumed 85.33 percent of the cost 
associated with the NIIN 015664394 the third highest cost driver to the DoD caused by 
GCU failures. (We started looking there because the top two NIINs represent the 
completed GCU assembly.) Again, because FRC Oceana and FRC Lemoore represent the 
major repair facilities for the F/A-18, this information supports further examination of 
circuit card costs. 


4] 


This information about cost drivers supports and increases the accuracy of process 
improvement efforts. Maintenance professionals can also compare items for the same 
TMS by NIIN in order to identify common items utilized by each command or unit, or to 
see if one item is less frequently used elsewhere. Identifying such trends can lead to the 
information we need to make good decisions regarding system support and 


improvements. 


F. CORRELATIONS 


Utilizing data bases like DECKPLATE or AFAST and correlation analysis, 
maintenance professionals can identify positive or negative correlations among repairable 
components. Examining the correlation between components is a way to tease out a weak 
link in the system, bundle components together when considering safety stocks, and 


reduce the need for independent forecasting. 


Figures 4 displays the top 10 repairable and consumable items ordered to repair 
GCUs. This figure was created using binary or dummy variables (1 if ordered O if not 
ordered) instead of raw data utilized in Tables 7 through 10. Hence, it shows the most 
frequently ordered items, not the most heavily used items. The light shaded columns in 


Figure 4 represent consumable items. 
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Top 10 Repairable & Consumable 
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Figure 4. Percentages of Top 10 Item Ordered 


With the data organized into dummy variables, the tables were then used to create 
another correlation analysis. This was done for several reasons. First, the correlations 
provide different sorts of information. In determining whether a certain kind of fault is 
frequently occurring, knowing how frequently parts are ordered together (reported below) 
may be more important than knowing whether the amount used varies together (reported 
above). Second, the high percentage of zeros (item not ordered) in the quantity ordered 
(the analysis reported above) tends to distort the strength of the correlations. The 
correlations reported below will examine exactly (and only) the relative frequencies of 
the four cases that are possible with two parts: (1) Part A and B both used in an order, 
(2) Part A used but B not used, (3) part B used but A not used, and (4) Neither Part A nor 
Part B used. 


Figure 4 illustrates the percentage of the time a part was utilized while repairing a 
single GCU. These are different from the usage percentages. For example, 178 power 
supplies were ordered to repair 1,118 GCUs (representing 16%). When converting the 
dummy variables (frequency ordered) to percentages, we find that Power Supplies are on 
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18% of orders, as shown in Figure 4. This is because the raw data accounts for the 
quantity ordered, while the ‘dummy variables’ only track whether an item was used (not 
the quantity used). The percentage is also higher because some JCNs contained more than 
one Generator. In accordance with the NAMP there should be one repairable per JCN 
therefore, finding this discrepancy shows a problem in data collection. Similarly, O-Ring 
0100515 was 16% in the usage data and 17% in the dummy variable form (frequency 
ordered). But, not all the items were different from the raw data; the majorities were 


exact matches and so helped verify the accuracy of our data. 


Based on this analysis, bundling of the repairable parts and the consumable parts 
might be considered. However, bundling repairable items must be based on a significant 
correlation otherwise it could prove costly and inefficient. The identification of these 
correlations is only the first step in the analysis required to determine which consumable 


parts might be intelligently bundled with repairable items. 


Table 11 illustrates the top ten items ordered from the data and also shows the Phi 
(®) correlation between power supply, NIIN 01-479-3818 and electronic card, 01-470- 
8685. The equation shown in the same table is the initial step towards finding the 
significance of the correlation. This example shows that the closer the numbers are to 
one, the higher their correlation to another component is. Nonetheless, numbers that are 
very small are not necessarily uncorrelated; the values can be small because of the sheer 
size of our sample. Table 11 also shows the 2x2 table utilized to explain the amount of 
times an item is present (or not) in a JCN. For example, the power supply was present in 


149 JCNs out of 2,425 total JCNs. 


Once Phi is identified, it can be used to calculate the P-value, which will show the 
significance of this correlation. Since Excel does not have a way to identify P-values for 
Phi, it is helpful to know that according to Cramer (1946): mathematically Phi‘2 is equal 
to Chi2 divided by n (the sample size) or 6° = y°/n. Therefore, Phi*2 multiplied by n is 
equal to Chi*2 denoted y= o * n. This is useful because Excel has a Chi‘2 distribution 


formula which shows the statistical significance of the correlation. 
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Utilizing the top ten items ordered, Table 12 shows the p-values derived from Phi 
by using the Excel function “1-CHISQ.DIST (x, deg _ freedom, cumulative)” where x= 
Chi‘2, deg _ freedom=1 (one is used for any similar 2x2 table), and cumulative=true. 
The p-value can be interpreted by looking at any intersection in which two parts meet. 
For example, on the top left corner, power supply and O-ring NIIN 01—005-—0515 are not 
significantly correlated, because there is a 42.7% chance that the times these parts were 
ordered together was just due to random variation, not due to any real relationship in 
usage of the two parts. Conversely, the top right corner power supply and electrical card 
there is less than a .001% chance that the frequency with which these items were ordered 
together was just due to random variation. Therefore, it is safe to say that the two have a 


significant correlation. 
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Table 11. Breakdown of Phi Correlation and How it was Used in Excel 
014793818 014708685 
a es ee 
)-0. Q2table |e 
® = (a d) (b c) POWER SUPPLY ELECTRONIC C 
Ma +b)-(e+d):- (atc): +a) 



















bl POWER SUPPLY O-RING O-RING CIRCUITCARD GENERAL ALTE MATCHED, EIBD=SSAEGIRONICC ELECTRONICCO TER 
Table 014793818 010050515 «001651942 «015452661 «015664393 «sé S684018 a: 914951173 





POWER SUPPLY 014793818 


7383) 
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Table 12. P-values Derived from Phi by Using 1-CHISQ.DIST 


P< Pet 
POWERSUPPLY O-RING O-RING CIRCUITCARD GENERAL, ALTE MATCHED, ELEC ELECTRONICC ELECTRONICCO TERMINALBOA ELECTRONICC 























di 014793818 010050515 001651942 015452661 015664393 = 015684018} 014708683 = 014951173 009507783 014708685 
POWER SUPPLY 014793818 0.427354116 0.00012298 4,13523E-07  7.35617E-08  4.67912E-08  7.02396E-09 4,09018E-09  9.12426E-10 
O-RING 010050515 0,00221926 1. 75598E-05  3.88534E-06 261028E-06 4.87756E-07  3.01722E-07 + 7.88671E-08 —4.88424E-08 
O-RING 001651942 0.109983385 0.09233534 0042527932 ~—0.033741742 ~—-0.017200666 —0.013421975 
CIRCUIT CARD 015452661 0.736764957 —0.673333691 + 0.441774378 ~=—0.387165035 ——0.259872718 
GENERAL, ALTE 015664393 0.931890363  0,664765542 0.596799356 + —0.428754646 
MATCHED, ELEC 015684018 0.727907952 —0,657337404 ~—_0.480198023 
ELECTRONIC C 014708683 0.923745124 —0.720108893 
ELECTRONIC CO 014951173 0.792843895 
TERMINALBOA 009507783 
ELECTRONIC C 014708685 
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The analysis of the correlation also reveals the following: 


First, it is confirmed that O-rings are frequently used which was also shown by 
Figure 4. Moreover, it showed O-ring NIIN 01—005-0515 as the top consumable item 
ordered. Examining only usage data, one might conclude that a large safety stock of this 
item should be maintained. But since previous analysis showed that a single squadron 
used this item heavily, increased safety stocks would not be warranted to support all 
squadrons, at least until the reason this squadron had excessive demand are determined. 
Also, the Phi correlations showed that the usage of this O-ring is significantly correlated 
to the usage of other O-rings, so any spike in demand at one squadron for this one O-ring 
in isolation is especially curious, and would need further investigation before safety 


stocks were adjusted. 


Second, Table 12 shows that by using Phi the true picture emerges though the 
correlation is small. It should be noted that there is still an indication of these parts being 
ordered together, hence the need to observe the failures in parts, such as the electrical 


card and the terminal board, since the correlation is stronger. 


G. VAMOSC 


The VAMOSC database is a great source of information but does not yield usable 
results for the purposes of this project. We tried using NAMSR directly from the 
VAMOSC website by using a query data under WUC 4211800, 42A1E00, 42A1E90, 
42X1E40, but without success. Contacting VAMOSC for assistance and providing our 
specific requirements, VAMOSC representatives provided the following fields of data: 
Fiscal Year, Type/Model/Series-Aircraft, NIIN, Nomenclature, AVDLR Cost, BCM 
Count, I-Level Consumable Cost, Depot-Level Consumable Cost, Total Consumable 
Cost, O-Level Cannibalization Count, I-Level Cannibalization Count, O-Level Labor 
Hours, I-Level Labor Hours, and Depot-Level Labor Hours. However, the lack of 
subcomponent data at this level rendered this very useful database impractical and not 
worth analyzing for our purposes. With that said it is hard to understand why a 
component such as the GCU, which is known to have a high failure rate, and in turn 


drastically affects cost and readiness. We had hoped to find large and detailed amounts 
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of data for components such this because of their impact on the Navy and knowing the 
purpose of acquisition cost analysis systems such as VAMOSC and the CAPE 
estimations is to project O&S cost of future weapon systems. The lack of component and 
subcomponent data suggests these data fields did not include order-level data or man 
hours utilized, which would have been essential to conduct a diagnostic analysis on cost 
drivers’ estimation for future weapon systems. Furthermore, we are left with this question 


-- why is such data, collected by the Navy, missing from the VAMOSC data base? 
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Vv. CONCLUSIONS 


A. SUMMARY 


The data systems used by the DoD have to be treated as an investment. These 
systems are tools that not only keep spending in the spotlight, but also allow maintenance 
professionals to implement cost-avoidance methods. Those methods which involve 
observing changes to man-hours, lead times and cannibalization or consumption rates, are 
necessary to make smart maintenance and budgetary decisions. Although the 
Maintenance Data System (MDS) already provides information available to support a 
bird’s eye view of combined unit operating cost for top tier commands’ decision-making, 
it denies a comprehensive view of low-level commands’ best practices, limiting the 
ability of Cost Assessment and Program Evaluation (CAPE) and other such entities to 


make accurate cost estimations. 


In this thesis, we constructed Pivot Tables to provide a view of cost and 
operations across the merging of AFAST and DECKPLATE datasets. We demonstrated 
the value of this multiple-data set view of the data in several examples. Our ability to 
organize data from multiple sources into groups allowed identification of trends; 
establishing highs and lows in quantities ordered and other useful analyses. The Pivot 
tables we created can isolate dates where noticeable changes occur, which can help 
pinpoint the cause of the change or at the very least, narrow the search. For example, in a 
hypothetical scenario we could assume the Active Electronically Scanned Array 
(AESA)’s system installation on the F/A 18, illustrated in Figure 1, represents the root 
cause of the sudden increase of GCU failures. The AESA’s system was installed in 2005 
and the data range used in our analysis did not cover this time period. However, we 


believe the methods we used would support this assumption. 


The answer to our primary research question is equivocal: based on our analysis, 
data systems do not appear to be capturing all the data necessary for decision making at 
the Organizational and Intermediate Levels. While we were able to find useful 


information about the GCU at the Organizational and Intermediate levels, we 


51 


encountered limitations in the data. Data from two primary sources were merged, 
however this merged view still produced an incomplete picture. The data lacked the 
necessary detail required to accurately predict proper inventories, safety stocks, and costs 
associated with Organizational, Intermediate, and Depot-level maintenance. Some data 
sources, which we thought would prove useful, lacked sufficient granularity to support 


our analysis. 


Specifically, the consolidation of man-hours, lack of data regarding Awaiting 
Maintenance (AWM) times, and the misleading representation of Elapsed Maintenance 
Time (EMT), made it difficult, if not impossible, to make accurate assumptions regarding 
safety stocks and inventory levels. In regards to the parts and materials being ordered, the 
data captured combined with the ability to assign that part to a Job Control Number 
(JCN), provided an opportunity to identify trends in failed parts and the ability to group 


them. 


Given our experience in the fleet and knowledge of the data being collected, we 
believe current systems are capturing the necessary data to make cost effective 
maintenance decisions at the Organizational and Intermediate levels, however, as the data 
is consolidated and pushed upstream critical data fields are left out, and not represented 
in a consolidated data system. We had hoped the merging of AFAST and DECKPLATE 
data would provide the necessary information, but it did not, therefore we cannot 
definitely say current data systems capture the necessary data to make cost effective 


maintenance decisions at the Organizational and Intermediate levels. 


B. RESEARCH LIMITATIONS 


We were unable to obtain a DECKPLATE account in order to explore the 
capabilities of the database and verify the current data collected. However, pursuing a 
DECKPLATE account was not necessary because our sponsors at NAVAIR provided 
pre-filtered data, containing a merging of databases utilized by the DoD. This data proved 
to be very useful. We would recommend that similar access be made available to all 


maintenance officers in the fleet. This access would provide aviation maintenance 
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professionals with valuable information that could be used to improve decision making 
and allow a more proactive approach to inventory control, logistics, and maintenance 


support. 


VAMOSC although a great tool for capturing the cost of major components, such 
as the F/A-18 or the F-35, did not provide the same capabilities at the subcomponent 
level. For example, the F/A-18 Type/Model/Series (TMS) CAPE shows costs associated 
with the TMS at levels starting from personnel, labor hours, parts, and overhead, all the 
way down to the Organizational level cost of parts and materials. However, because a 
component or subcomponent, such as a mission computer or radar system that is part of 
the same TMS, would not have the same detail; thus, the possibility of seeing O&S costs 
at the basic component level was not available. VAMOSC is very useful at capturing 
detailed data at the weapon system level (e.g., F/A-18 Super Hornet program) as Table 3 
shows. However, the history of GCU failures cannot be tracked or analyzed with 


VAMOSC data. 


AFAST’s data is limited to spending, so pairing it with other data is time 
consuming and difficult. AFAST did bring additional awareness, raising questions like: 
“Why doesn’t your organizations’ spending match other sister commands?,” “Why has 
spending increased on particular items?” and most importantly, “What are others doing 


right so that those better business practices can be implemented across the board?” 


AFAST did not contain the same level of detail as DECKPLATE, which is 
understandable because DECKPLATE incorporates more databases to its centralized 
warehouse. We encountered instances in which data was captured by DECKPLATE but 
was missing from AFAST, even though AFAST should have captured the data. For 
example, the JCN was located at both databases; however, AFAST had blank fields 
containing no data. 

Our research could have benefited from more data fields, specifically AWM 
reason codes which represent a reason for maintenance to stop and accounts for 
maintenance hours between worked maintenance hours. Table 13 is a list of AWM codes 


and their meaning: 
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Table 13. List of AWM Codes and their Meaning 


M3. AWM Backlog 


M4. AWM Off Shift WP. AWP In Shop 


DD. Analyst Delete WQ. AWP In AWP Locker 
M6. AWM Awaiting AIMD WS. AWP Work Stoppage 
C. Job Complete M7. AWM Flight/Operational |WT. In Transit to AWP Locker 





Knowing the times associated with the AWM codes in Table 13 would 
dramatically improve the usefulness of this data. For example knowing the Waiting Parts 
(WP) would define how long a system had to wait for parts or materials to arrive before 
maintenance could continue repairing the component. Having this data field and grouping 
components in this manner would provide better insight when calculating the quantities 


of materials needed to maintain readiness. 


CG RECOMMENDATIONS 


In conducting our analysis, we found we needed data from multiple sources, and 
we found data integrity issues which seemed to revolve around data capture, which 
hampered our analysis. Hence, we recommend removing as much of the manual input to 
the system as possible, accompanied by the merging of data collecting sources to tie 
information together. We believe this is essential to maximizing the use of the vast 
amounts of data collected by the DoD. 

Adopting a data system that works to consolidate collected data would increase 
the number of ways we can compare and measure data. Consolidating data views to 
facilitate the sort of analysis we report in this thesis is an approach which will empower 
aviation maintenance professionals to take a more proactive role instead of the reactive, 
budgetary role currently employed. Such a system would fill in gaps we found in our 
analysis when using AFAST data, and trying to use VAMOSC data. 

Based on our analysis of the data we extracted, we have come to believe that 
maintenance systems in O and I-level maintenance organizations should be merged and 


completely seamless, and these systems should interact with a single supply system that 
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can match locations, dates, and times to materials. These data should be provided in real 
time, or as close to real time as possible, throughout a single maintenance and supply 
system used by the DoD. Maintenance hours should not be the only time that is tracked 
because in-work date and date completed do not provide enough information. A supply 
system that provides the time that a part spends in the supply system and all the other 
steps or stops along the way is extremely valuable. These times can be used to calculate 
wait times and identify bottlenecks. These time periods should match maintenance data 
systems times entered for work being stopped and/or awaiting parts. Trouble shooting 
and logistics supporting times must be accurately factored in. These seamless systems 
should be able to provide current, as well as historic, logistics data. 

Knowing when and where parts and materials are, and who is ordering or 
consuming them, can be used to determine whether the process, location, and installation 
could benefit from consolidation. Maintenance systems need to be designed to track 
installed components and flag their time in service by capturing the service life of 
components in their intended environment. Decision-makers would have the ability to see 
the mean time between failures of the components that make up the weapon system. This 
data, in conjunction with accurate lead times and consumption rates, can be used to 
provide better estimates on safety stocks and improve the cost and accuracy of inventory 
management. 

Naval aviation professionals are proud of the amount and richness of the data 
collected by the fleet. However, we occasionally encountered data that in our opinion and 
experience as naval maintenance officers was questionable. We believe our databases are 
limited by human input errors, and missing data fields, thus resulting in significant 
limitations regarding the data available for research. Incorporating more automation in 
our data collecting system, while, keeping no value added redundancy out would reduce 


the chance of human error. 


D. CONCLUSIONS 


The DoD has access to all of the information described in this chapter and for the 
most part, is actively collecting this information in multiple data systems that are not 


linked. It would require extensive amounts of time and money to filter and organize this 
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information into useful data, but a data system that could consolidate this information has 
the potential to save time and money. A consolidated system would meet the needs of 
multiple entities in the DoD, from budgeting to manpower, contracting to trouble 
shooting weapon systems. This would be a worthwhile investment that should and can 
be, based off of existing technology. This data collection and the interactive analysis 
tools are essential to all decision makers while implementing cost related decisions 
moreover these tools could bring the current reactive mind set to a change, that would 
add cost avoidance technics initiated placed at hands of the leaders at the lowest levels. 
Our hope is that we have furthered the discussion for the extensive use of automated data 
collection systems, and added to the momentum for improved implementations of 


standardized data collection and organization processes throughout the DoD. 
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